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NETWORK SYSTEM FOR COMPOSING MUSIC BY 
COLLABORATION OF TERMINALS 

BACKGROUND OF THE INVENTION 

(i) Field of the Invention 

The present invention relates to a system, method 
and recording medium for composing music data, particularly 
for composing music data by collaboration of a plurality of 
persons . 

(ii) Description of Related Art 

In a conventional music data composition apparatus, 
one user composes a musical work, collaboration by a 
plurality of persons is impossible, good idea may not be 
easily created by one person, and in this manner there are 
limitations in music composition, 

SUMMARY OF THE INVENTION 
The present invention has been developed in 
consideration of the aforementioned drawbacks of the related 
art, and an object of the invention is to provide a music 
data composition system in which a chat function is used to 
collect ideas of a plurality of users and to enable 
collaboration in preparation of music data by the plurality 
of users, each user can access common music data, and further 
one of the users is allowed to take leadership entirely in 
composition of the music data so that music data 
collaborating operation by the plurality of users can easily 
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be managed. 

In a main aspect of the present invention, a system 
is designed for composing music data representative of a 
music composition according to composing data representative 
5 of a material of the music composition , the system comprising 
a plurality of information processing terminals and a control 
station for mutually connecting the plurality of the 
information processing terminals through the control station, 
wherein each information processing terminal comprises a 
ftO conversation section that can be operated to exchange 
H messages with other information processing terminal and an 

:o input section that can be operated to input the composing 

data while exchanging the messages with other information 
pi processing terminal, and wherein the control station 

5 15 comprises a composing section that composes and edits the 
music data according to the composing data inputted by the 
plurality of the information processing terminals to thereby 
collaborate the plurality of the information processing 
terminals for creating the music composition. Preferably, 
20 the control station further comprises a control section that 
exclusively controls the inputting of the composing data 
among the plurality of the information processing terminals 
such that only one information processing terminal is allowed 
to input the composing data at one time to avoid conflict of 
25 the composing data among the information processing terminals. 
Preferably, the control station further comprises a public 
storage section for storing the music data such as to make 



the music data available publicly. 

In an additional aspect of the present invention, 
the control station or a server apparatus further comprises a 
feedback section that feeds back the edited music data to the 
5 plurality of the information processing terminals or client 
apparatuses so that each client apparatus can collaborate 
with other client apparatus for creating the music 
composition by repetition of the transmitting of the 
VJ composing data and the receiving of the music data. 

JLO Preferably, each client apparatus further comprises a 
F downloading section that downloads a program from the server 

£• apparatus so as to install an interface by the downloaded 

r program for transmitting the composing data and receiving the 

rf,, music data. Preferably, each client apparatus further 

is comprises an output section for displaying the received music 
data in the form of a score of the music composition, so that 
the input section can input the composing data in the form of 
music symbols superposed on the displayed score of the music 
composition . 

20 In a further aspect of the present invention, the 

client apparatuses include a child client apparatus and a 
parent client apparatus that has a higher capability of 
inputting the composing data than the capability of the child 
client apparatus , thereby allowing the parent client 

25 apparatus to precede the child client apparatus in the 

creation of the music composition. Preferably, only the 
parent client apparatus can instruct the server apparatus to 
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register the music composition while the child client 
apparatus is allowed to download the music data of the 
registered music composition from the server apparatus. 
According to the main aspect of the present 
5 invention, a system provided with a chat function is 

constructed, a plurality of users operating a plurality of 
information processing terminals (client PCs), respectively, 
t have chats with one another by exchanging conversation data 
m (messages), and simultaneously input composing data (partial 
ft) music data such as a note), and music data is composed based 
f on these composing data. Therefore, a plurality of persons 
L can present ideas to compose a musical work. 
H According to the additional aspect of the present 

Hp invention, in a system constituted of a plurality of client 
3?5 apparatuses and a server apparatus, composing data is 

inputted on the client apparatus, music data is composed on 
the server apparatus in accordance with an instruction from 
the client apparatus, and the latest music data is displayed 
in the respective client apparatuses. Therefore, the common 
20 music data is accessed from the respective client apparatuses, 
so that music notes can be inputted, edited, and displayed, 
and collaboration is possible by a plurality of users who 
operate the plurality of client apparatuses, respectively. 
According to the further aspect of the present 
25 invention, parentage is set in a plurality of client 

apparatuses, and an executable function is allowed to differ 
between parent and child. Typically, the parent client 



apparatus is set to be multifunctional. Therefore, the user 
of the parent client apparatus can take leadership entirely 
in music data preparation, and collaborating operation by the 
plurality of users can easily be managed. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a functional block diagram of the music 

data composition system according to one embodiment of the 

present invention . 

Fig. 2 is a block diagram showing a hardware 

constitution of a server apparatus in the music data 

composition system according to one embodiment of the present 

invention . 

Fig. 3 is a block diagram showing a hardware 
constitution of each client PC in the music data composition 
system according to one embodiment of the present invention. 

Fig. 4 shows one example of a display screen on the 
client PC according to one embodiment of the present 
invention . 

Fig. 5 shows another example of the display screen 
on the client PC according to one embodiment of the present 
invention . 

Fig. 6 is a flowchart showing a process executed in 
a server apparatus for composing music data according to one 
embodiment of the present invention. 

Fig. 7 is a flowchart showing a process executed in 
the client PC for composing the music data according to one 
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embodiment of the present invention. 

Fig. 8 is a flowchart showing a chat process 
executed in the server apparatus and a chat function process 
executed in the client PC according to one embodiment of the 
5 present invention. 

Fig. 9 is a flowchart showing a composition process 
executed in the server apparatus according to one embodiment 
y3 of the present invention. 

Ill Fig. 10 is a flowchart showing a composition applet 

W process executed in the client PC according to one embodiment 
y, of the present invention. 

Fig. 11 is a flowchart showing a mailer process 
F- executed in the client PC according to one embodiment of the 
e ; present invention. 

Ts Fig. 12 shows a display screen example of the mailer 

process in the client PC according to one embodiment of the 
present invention . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
20 A preferred embodiment of the present invention will 

be described hereinafter in detail with reference to the 
drawings. Additionally, the following embodiment is simply 
one example, and various modifications are possible in a wide 
scope without departing from spirit of the present invention. 
2 5 Fig. 1 shows a functional block diagram of a music 

data composition system according to one embodiment of the 
present invention. In this embodiment, the system is 



1 
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constituted of a server computer (hereinafter referred to 
simply as "server") 1 and a plurality of client personal 
computers (client PCs) 2, 3, . .. (only two computers are 
shown in Fig. 1), the server 1 is provided with a composition 
5 processor la, a chat processor lb, a public data storage 
section lc, a personal data storage section Id, and a 
communicator le. The client PCs 2, 3, ... are provided with 
4% composition applet processors 2a, 3a, local storage 

m sections 2b, 3b, . .., WEB browsers 2c, 3c, mailers 2d, 

|i) 3d, . . . , communicators 2e, 3e, and other components. 

y* The server 1 performs communication with the client 

L PCs 2, 3, ... via the communicator le and a communication 
if network 4, and transmits a composition applet (program 
f written in JAVA language) to the respective client PCs 2, 
fcS 3, ... from the chat processor lb upon receiving an 

instruction for entrance to a chat room from the respective 
client PCs 2, 3, ... The respective client PCs 2, 3 receive 
the composition applet from the communication network 4 via 
the communicators 2e, 3e, and the composition applet is 

20 operated by the composition applet processors 2a, 3a, ... to 
perform a composition applet processing. When a composition 
instruction for inputting or editing music notes is performed 
in the respective client PCs 2, 3, the composition 

instruction is transmitted to the server 1 via the 
25 communicators 2e, 3e, ... and communication network 4. 

On the side of the server 1, upon receiving the 
composition instruction from the respective client PCs 2, 
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3, ... via the communicator le from the communication network 

4, the composition processor la of the server 1 composes 
actual music data based on the composition instruction. 
Specifically, only the composition instruction is performed 

5 on the side of the client PCs 2, 3, and an actual 

composing operation is performed on the side of the server 1 . 
Here, the composition instruction is available from any one 
% of the client PCs 2 , 3 , ... 

^ Additionally, in this network system, these client 

ijp PCs 2, 3, ... are provided with parentage, one of the client 
;:P PCs 2 , 3 , ... is set as a parent client , and the other client 
^ PCs are set as child clients. In the following, as shown in 
if parentheses of the drawings, the client PC 2 will be 
45 designated to the parent client, and the other client PCs 
15 3, ... will be designated to the child clients. For example, 
in a simplest system constituted of two client PCs 2 and 3, 
one client PC 2 serves as the parent client, and the other 
client PC 3 serves as the child client. Additionally, three 
or more client PCs may be involved in the system. In this 
20 case, any one of the client PCs serves as the parent client, 
and other client PCs serve as the child clients. Moreover, 
three or more users can simultaneously enter a chat room 
(described later). 

When any one of the client PCs 2, 3, ... performs 
25 partial composition or arrangement, composing data (partial 
music data, note string, and the like) as a content of the 
partial compos it ion /arrangement is also transmitted to the 
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other client PCs via the server 1 , and displayed on a monitor 
display. Moreover, a chat function is utilized to perform 
conversation among the respective client PCs 2, 3, hence 
the music note input and music score arrangement are advanced, 
5 and thus the music is completed. 

The chat function is performed by the WEB browsers 
2c, 3c, ... of the client PCs 2, 3, ... and the chat 
processor lb of the server 1. When there is input of an 
^ message from a certain client PC, the message is transmitted 
to and registered in the server 1, and additionally this 
+ registered message is also transmitted to other client PCs. 

t Therefore, in the simplest system provided with the parent 

H client PC 2 and the child client PC 3 as described above, the 

message from the parent client PC 2 is registered in the 
145 server 1, and transmitted to the child client PC 3. 

Additionally and conversely, the message from the child 
client PC 3 is also registered in the server 1, and 
transmitted to the parent client PC. In this manner, among 
the client PCs 2, 3, mutual messages are displayed on 

20 the displays of the respective client PCs 2, 3, ... via the 
server 1, and conversation proceeds as to composition of the 
music. 

The server 1 is provided with the public data 
storage section lc as a storage area common to the users of 
25 the respective client PCs 2, 3, and provided with the 

personal data storage section Id as the storage area for each 
user ID of the respective client PCs 2, 3, and is also 
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provided with a temporary storage area (not shown) in the 
composition processor la. During the composing operation, 
the data is stored in the temporary storage area disposed in 
the composition processor la of the server 1, and upon 
completion of a musical work (otherwise the work may be 
incomplete, but in a good stopping place of the composing 
operation) , the composed music data can be stored in the 
personal data storage section Id or the public data storage 
section lc of the server 1 in accordance with the instruction 
from the parent client PC 2 . 

Moreover, in this case, the parent client PC 2 can 
store the composed music data in its own local storage 
section 2b. On the other hand, the child client PCs 3, ... 
can store the music data in their own local storage sections 
3b, but their data cannot be stored on the server 1. 

Specifically, the music data obtained by collaboration of a 
plurality of client PCs 2, 3, ... is basically regarded as 
the data composed by the parent client PC 2, and only the 
parent client PC 2 is given a right to store the data on the 
server 1. The mailers 2d, 3d, ... of the respective client 
PCs 2 , 3 , ... are provided with a function of transmitting an 
electronic mail in which a uniform resource locator (URL) of 
the music data is written. The music data stored in the 
public data storage section lc can be accessed by any one of 
the client PCs 2, 3, whether the client PC is parent or 

child. For example, this data can be accessed from a 
receiver of the electronic mail with the URL of the composed 



music data described therein. 

Namely, the inventive system is constructed for 
composing music data to create a music composition according 
to composing instructions. The system is constructed by a 
plurality of client apparatuses 2, 3 and a server apparatus 1 
that connects to the plurality of the client apparatuses 2, 3 
through a network 4 for collaborating the plurality of the 
client apparatuses 2, 3 in creation of the music composition. 
In each of the client apparatuses 2, 3, an input section is 
operated for inputting composing instructions. The client 
apparatuses includes a child client apparatus 3 and a parent 
client apparatus 2 that has a higher capability of inputting 
the composing instructions than the capability of the child 
client apparatus 3. In the server apparatus, a composing 
section la composes the music data to create the music 
composition according to the composing instructions fed from 
both of the parent client apparatus 2 and the child client 
apparatus 3, while allowing the parent client apparatus 2 to 
precedes the child client apparatus 3 in the creation of the 
music composition. Only the parent client apparatus 2 can 
instruct the server apparatus 1 to register the music 
composition while the child client apparatus 3 is allowed to 
download the music data of the registered music composition 
from the server apparatus 1. 

Figs . 2 and 3 show hardware constitutions of the 
server and client PC in the music data composition system 
according to one embodiment of the present invention, a 
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plurality of client PCs 2, 3, ... constituting the system can 
employ substantially the same hardware constitution, and 
therefore Fig. 3 shows only one client PC. In Fig. 2, the 
server 1 is provided with a central processing unit (CPU) 11, 
5 a read-only memory (ROM) 12, a random access memory (RAM) 13, 
an operating control detection circuit 14, a display circuit 
15, an external storage device 16, and a communication 

™: interface (I/F) 17, and these devices 11 to 17 are connected 

fj to one another via an internal bus 18. 

||) The server controlling CPU 11 provided with a timer 

P 19 performs various controls in the server in accordance with 
s a predetermined program, and particularly executes a chat 

i«i processing and a composition processing as the function of 
j£ the chat processor lb and the composition processor la, the 
p5 music data composition processing being conducted on the side 
of the server 1 in a central manner. In the ROM 12, a 
control program for the music data composition and various 
data/tables are stored, and in the RAM 13 various data being 
processed are temporarily stored. 
20 The operating control detection circuit 14 is 

connected to an operating device (keyboard, mouse, and the 
like) 1A including a panel switch and other operating 
controls, the display circuit 15 is connected to a display IB, 
and the external storage device 16 is constituted of a hard 
2 5 disk drive (HDD) and other drive devices of transportable 
storage media such as a compact disk read-only memory (CD- 
ROM) drive, floppy disk drive (FDD), magnetooptic (MO) disk 
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drive, and digital videodisc drive (DVD). The external 
storage device can store various control programs and various 
data including music data, and is particularly provided with 
a function of the personal data storage section Id and the 
public data storage section lc. The communication I/F 17 can 
use, for example, Ethernet or another communication interface 
to perform communication with a plurality of client PCs 2, 
3 , . . . via the communication network 4 such as LAN and 
Internet . 

In Fig. 3, each of the client PCs 2, 3, ... is 
provided with a client controlling CPU 51, ROM 52, RAM 53, 
first and second detection circuits 54, 55, display circuit 
56, sound source circuit 57, effect circuit 58, external 
storage device 59, communication interface (communication 
I/F) 60, MIDI interface (MIDI I/F) 61, and the like, and 
these devices 51 to 61 are connected to one another via a bus 
62 . 

The client controlling CPU 51 is provided with a 
timer 63 utilized for generation of a tempo clock or an 
interrupt clock, performs various controls in the client in 
accordance with the predetermined program, but particularly 
performs a WEB browser processing, chat function processing, 
composition applet processing and mailer processing by means 

of the WEB browsers 2c, 3c, composition applet 

processors 2a, 3a, and mailers 2d, 3d, and performs 

other music data composition processings on the side of the 
client PC in a central manner. In the ROM 52, various 
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programs concerning the music data composition processing and 
various data/tables are stored, and in the RAM 53 various 
data being processed are temporarily stored. 

A performance operating control device 64 connected 
to the first detection circuit 54 is provided with 
performance operating controls of a music keyboard type, or 
performance operating controls using alphanumeric keyboard 
keys allotted to predetermined music pitches (e.g., a group 
of character keys), and a panel operating control device 65 
for various input settings, connected to the second detection 
circuit 55, is provided with a panel switch type operating 
element, or a switch operating element using the keyboard key 
(e.g., various keys except the character keys) or a mouse. 
The display circuit 56 is connected to a display 66 and 
various indicators, and on the display 66, an input setting 
button operable by the switch operating element can be 
displayed. 

Moreover, a sound system 67 connected to the effect 
circuit 58 constituted of DSP constitutes a musical sound 
output section together with the sound source circuit 57 and 
effect circuit 58, and a musical sound can be emitted, and 
listened to evaluate the music during the composing operation 
or after the composition, or other music performance. 

Similarly as the external storage device 16 of the 
server 1, the external storage device 59 is constituted of 
the HDD and the drive devices of transportable storage media, 
can store various control programs and various data including 
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the music data, and is particularly provided with the 
function of the local storage sections 2b, 3b, . . . The 
respective client PCs 2, 3, ... can use the aforementioned 
communication interface, modem, and the like in the 
5 communication I/F 60 to perform communication with the server 
1 via the communication network 4. In this example, the 
respective client PCs 2, 3, ... can further communicate with 
another MIDI apparatus 7 via the MIDI I/F 61, and the music 
^ I/F 61 is not limited to an exclusive MIDI interface, and may 
4) be constituted using general-purpose interfaces such as RS- 
* ; 232C, universal serial bus (USB), and IEEE 1394. In this 
1 case, music data other than MIDI message may also be 

H transmitted/received at the same time. 

Jp Figs . 4 and 5 show display screen examples on the 

U> client PC according to one embodiment of the present 

invention. The server 1 regards a group constituted of 
arbitrary client PCs which perform the composing operation as 
"chat room", and manages situations of one group or a 
plurality of groups, and the users of the respective client 

20 PCs 2, 3, ... are given user IDs and nicknames. First, when 
the user starts the WEB browsers 2c, 3c, the server 1 

displays a screen of "chat room use situation window" on the 
display 66 of the client PC as shown in Fig 4, and notifies 
the respective users who intends to enter the chat room 

25 (composition group) of a chat room use situation. 

In the display screen example of Fig. 4, there are 
ten chat rooms in total provided with room numbers "No. 1" to 



"No. 10" (i.e., the number of simultaneously operable working 
groups is ten), and terms indicating the use situations, such 
as "vacant", "available" and "occupied" are displayed for the 
respective chat rooms. The term "vacant" indicates that one 
can enter the room as the parent client, and "available" 
indicates that the parent client has already entered the room 
and the child client is wanted or only additional one can 
enter the room. Moreover, the term "occupied" indicates that 
both the parent client and the child client have already 
entered the room and further entry is impossible, and any 
chat cannot be started until the "occupied" state is obtained. 

Then, when the user selects /designates a chat room 
to enter from the rooms labeled with "vacant" or "available" 
displayed thereon, a display window (not shown) for inputting 
the user ID, and nickname opens. Subsequently, when the user 
ID, nickname, and the like are inputted, the inputted 
information is transmitted to the server, and entrance to the 
selected/designated chat room is permitted. Upon entrance to 
the chat room, "chat window" is displayed as the WEB browser 
on the display 66 as shown in Fig. 5, further "composition 
window" newly opens, and execution of chat and composing 
operation is made possible. The composition window is based 
on the composition applet sent from the server 1. 

In the display screen example of Fig. 5, the "chat 
window" on the left side of Fig. 5 is provided with an 
message input area IA for performing character input of 
message during chat, and a "message reload" button RB for 
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reload of the messages (registration into the server 1, and 
take-in and display of massages). Moreover, in a lower 
message display area, as shown by an arrow on the left end, a 
new message is successively written/added on the upper side 
5 of the previous message, and the latest message is displayed 
on a topmost column. 

On the other hand, the "composition window" on the 
V right side of Fig. 5 is provided with a score area SA, symbol 

palette SP, and multifunctional button group FB. Musical 
IfD symbols such as a note and a rest are displayed in the symbol 
;P palette SP in such a manner that the symbols can be 
^ designated. The multifunctional button group FB includes a 
H "store in server (public)" button PS, "store in server 
* (personal)" button SS, "store in local" button LS, "store in 
Its an up-to-date state" button UD, "input /edition end" button ED, 
and the like, and further, though not shown, a sounding mode 
button for sounding of the designated note and the musical 
piece being composed, or a button for performing copy, 
deletion, movement, and other general edition processing can 
20 be included. 

It is now assumed that the user of the client PC 2 
enters a certain chat room as the parent client, the user of 
the client PC 3 enters the same chat room as the child client, 
and the chat room is turned "occupied" to enable the chat. 
2 5 This case will be described hereinafter. In this "occupied" 
state, the chat is possible, and the users consult with each 
other by the chat using the "chat window", and utilize the 
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composition window to proceed with composition of music. 

To perform the message exchange , after inputting a 
sentence in the message input area IA, the "message reload" 
button RB is pushed. Then, the sentence inputted in the 
message input area IA is registered as the latest message on 
the side of the server 1, and the latest message is displayed 
on the client PC of the user having inputted the message. In 
this stage, the message content is not displayed on the 
client PC of the other user, but the other user pushes the 
"message reload" button RB to reload the latest message on 
the client PC, and can read the latest message. Additionally, 
the other user can register the message on the side of the 
server 1 by inputting a sentence in the message input area 
and by pushing the "message reload" button. 

Additionally, there may be provided a function of 
automatically performing the reload every predetermined time 
(e.g., 30 seconds or the like). In this case, the time to be 
set may be fixed or be changeable by the user. 

In order to input/edit the composing data (partial 
music data) and perform the composition, a desired symbol is 
selected/designated from various musical symbols displayed in 
the musical symbol palette SP of the composition window (the 
right side of Fig. 5), and the selected/designated symbol is 
pasted onto a music score displayed in the score area SA by 
drag/ drop or another operation by the panel operating control 
device 66 (mouse or the like) . Alternatively, by operating 
the music keyboard operating element or the alphanumeric 
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keyboard character key group used as the performance 
operating control device 65 in the respective client PCs 2, 3, 
music notes may be inputted (additionally, when the character 
key group is used, the predetermined pitch is assigned to 
5 each character key) . Additionally, by operating various 

editing buttons in the multifunctional button group FB, the 
copy, deletion, movement or another edition is possible. 
C Here, while a certain user is performing 

H input /edition, the remaining users may be prohibited from 
M performing the input/edition. Specifically, while one of the 
£ users of the parent client PC 2 and child client PC 3 

performs the input /edition with respect to the music data, 
§1 the other user may be prohibited from performing the 

input/edition- For example, by pushing the "input/edition 
|| end" button ED in the multifunctional button group FB in the 
composition window, the other client PC may be allowed to 
perform the input/edition. Moreover, a display may be 
controlled to the effect that while one member is performing 
the input /edition, another member cannot perform the 
20 input /edition . 

The user can see the state of the input/edition 
performed by oneself on the own client PC, but cannot see the 
content of the input /edition by the other user (partner) as 
it is. To display the content of the result inputted/edited 
25 by the partner, the "update in up-to-date state" button UD in 
the multifunctional button group of the composition window is 
pushed. Additionally, this is not limitational, and 
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automatic update may be performed every predetermined time, 
or update may be performed synchronously with reload of the 
chat message. 

As described above, and referring back to Figs. 1, 2 
and 3, the inventive system is designed for composing music 
data representative of a music composition according to 
composing data representative of a material of the music 
composition. The system is constructed by a plurality of 
information processing terminals 2, 3, and a control 

station 1 for mutually connecting the plurality of the 
information processing terminals 2, 3 through the control 
station 1. In each information processing terminal 2, a 
conversation section 2e can be operated to exchange messages 
with other information processing terminal 3, and an input 
section 64 and 65 can be operated to input the composing data 
while exchanging the messages with other information 
processing terminal 3. In the central station 1, a composing 
section la composes and edits the music data according to the 
composing data inputted by the plurality of the information 
processing terminals 2, 3 to thereby collaborate the 
plurality of the information processing terminals 2, 3 for 
creating the music composition. Preferably, the control 
station 1 exclusively controls the inputting of the composing 
data among the plurality of the information processing 
apparatuses 2, 3 such that only one information processing 
terminal is allowed to input the composing data at one time 
to avoid conflict of the composing data among the information 
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processing apparatuses 2, 3. Preferably, the control station 
is provided with a public storage section le for storing the 
music data such as to make the music data available publicly. 
Further, the control station 1 feeds back the composed music 
5 data to each information processing terminal 2, 3 such that 
each information processing apparatus 2, 3 can input further 
composing data of the fed music data. 
W In the embodiment of the present invention, internal 

^ data of the musical composition handled on the server 1 is 
W not based on a general MIDI form, but is based on a general- 

purpose text type form. In this internal data form, fine 
s sound representation of sound volume or timing cannot be 

C described, but there is an advantage that the music data can 
j? be handled by a simple program of a text editor or the like. 
fS For example, with a note string containing "C3 of a 

quarter note" -» "D3 of a quarter note" n E3 of an eighth 
note" -» "an eighth rest" -> "D3 of a quarter note", in the 
embodiment of the present invention, "nqC3. nqD3. neE3. re. 
nqD3" is described as the internal data form. Here, "n" 
20 denotes "note", "q" denotes "quarter", "e" denotes "eighth", 
"r" denotes "rest", and "." denotes each note end position. 
Similarly, "half" is represented by "h", "whole" is 
represented by "w" , and "sixteenth" is represented by "s". 
Figs. 6 and 7 are flowcharts showing a server 
25 processing and client PC processing performed by the server 
and client PC for music data composition, respectively, 
according to one embodiment of the present invention. First, 
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on the side of the client PCs 2, 3, a WEB browser 

processing is executed in first to fifth steps CI to C5 in a 
client PC processing flow of Fig. 7, and at the same time, on 
the side of the server 1, first to third steps SI to S3 are 
5 executed in a server processing flow of Fig. 6. 

In the first step CI of the client PC processing 
(Fig. 7), the client PC users start the WEB browsers 2c, 
Q 3c, ... and access the chat room, while in the first step SI 
S| of the server processing (Fig. 6), the server 1 transmits the 
j|§ room use situation screen data to the client PC in response 
|; to the access to the chat room. On the client PC side, based 
I on the received use situation screen data, the "chat room use 

f7 situation window" is displayed on the display 66 as shown in 
Fig. 4 (step C2 : Fig. 7), and the client PC user is notified 
j?S> of the chat room use situation. 

Subsequently, when the user selects /designates a 
room number from the "vacant" or "available" chat rooms and 
indicates entrance to the desired chat room (step C3: Fig. 7), 
"display window" (not shown) opens so that the user utilizes 
20 the "display window" to input the user ID, nickname and other 
information. Then, a command for entrance to the chat room, 
and the room number, user ID, nickname and other information 
are transmitted to the server (step C4: Fig. 7). On the 
other hand, the second step S2 of the server processing (Fig. 
25 6) is executed on the side of the server 1. 

In the step S2 (Fig. 6), based on reception of the 
entry command, the server 1 determines the client PC of the 
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received user ID as either the parent client or the child 
client in accordance with the chat room situation of the 
indicated room number, and permits the client PC to enter the 
chat room. Subsequently, the display screen data and the 
composition applet of the concerning room number are 
transmitted to the client PC. On the client PC side, based 
on the received display screen data and composition applet, 
the "chat window" and "composition window" are displayed on 
the display 66 as shown in Fig. 5 (step C5: Fig. 7), and 
execution of the chat and composing operation by the client 
PC user is possible. 

This chat and composing operation is achieved by 
successively, simultaneously and repeatedly executing a "chat 
function processing" of step C6 and "composition applet 
processing" of step C7 in the client PC (Fig. 7), and a "chat 
processing" of step S3 and "composition processing" of step 
S4 in the server (Fig. 6). Furthermore, on the server 1 side, 
after performing "other processings" in step S5 , the flow 
returns to the step SI to repeat the processing of steps SI 
to S5. On the client PC side, after performing a "mailer 
processing" in step C8 , and performing "other processings" in 
step C9, the flow returns to the step C6 to repeat the 
processing of steps C6 to C9. 

Additionally, the "other processings" of the server 
1 in the step S5 includes a processing for managing a 
plurality of chat rooms and a general processing of the 
server computer. Moreover, the "other processings" of the 



client PC in the step C9 includes various setting processings 
based on the operation of the panel operating control device 
65, and processings about various functions of a general 
automatic performance apparatus such as music reproduction 
start /stop and tempo change. 

Fig. 8 is a flowchart showing the chat processing 
conducted in the server and the chat function processing 
conducted in the client PC according to one embodiment of the 
present invention. In Fig. 8, left-side processing flow 
shows in detail the "chat processing" performed by the server 
1 in the step S3 of Fig. 6, and right-side processing flow 
shows in detail the "chat function processing" performed by 
the client PC in the step C6 of Fig. 7. 

In a first step CC1 of the chat function processing, 
the client PC user uses the "chat window" shown in Fig. 5, 
inputs the message in the message input area IA, and operates 
the "message reload" button RB. Then, in a second step CC2 , 
in response to the operation of the "message reload" button 
RB, the user ID, nickname, the message, and the reload 
command are transmitted to the server 1. Moreover, if there 
is no input of messages, only a reload command based on the 
operation of the "message reload" button RB is transmitted to 
the server 1. Moreover, in the next step CC3 , with an elapse 
of a predetermined time (e.g., 30 seconds or the like as set 
beforehand) , the reload command based on the elapse of the 
predetermined time is transmitted to the server 1. 

On the other hand, on the server 1 side, in a first 



step SCI of the chat processing, in response to reception of 
the message or the reload command (inputted particularly by 
the button RB), the message is registered, and the latest 
message is transmitted to the client PC of the user who has 
inputted the message or the user who has operated the 
"message reload" button RB. Moreover, in a second step SC2, 
in response to reception of the reload command (particularly, 
inputted by the elapse of time), the latest message is 
transmitted to the client PC of the user who has transmitted 
the reload command, and the flow returns to the next 
"composition processing" (step S4:Fig. 6). 

On the other hand, on the client PC side, in the 
step CC4 of the chat function processing, in response to 
reception of the latest message, the latest message is 
displayed on the display 66 in such a manner that the message 
content is displayed in the topmost column of the message 
display area as shown on the lower left of Fig. 5, and the 
flow returns to the next "composition applet processing" 
(step C7 : Fig. 7) . 

Figs. 9 and 10 are flowcharts showing the 
composition processing performed in the server and the 
composition applet processing performed in the client PC, 
respectively, according to one embodiment of the present 
invention. The processing flow of Fig. 9 shows in detail the 
"composition processing" performed by the server 1 in the 
step S4 of Fig. 6, and the processing flow of Fig. 10 shows 
in detail the "composition applet processing" performed by 
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the client PC in the step C7 of Fig. 7. 

When the client PC user uses, for example, the 
"composition window" shown in Fig. 5, and inputs/edits the 
desired notes on the score area SA by the musical symbols of 
the musical symbol palette SP. The input, edition, and the 
like of the notes constitute the composition instruction, and 
in a first step CE1 of the composition applet processing (Fig. 
10), the input/edition content is transmitted to the server 1 
as occasional demands. On the server 1 side having received 
this, in a first step SE1 (Fig. 9) of the composition 
processing, in response to reception of the input/edition 
content, the input /edition of the music data is executed. 

Moreover, when the client PC user operates the 
"update in up-to-date state" button UD in the multifunctional 
button group FB of the "composition window", in a second step 
CE2 of the composition applet processing (Fig. 10), in 
response to the operation of the "update in up-to-date state" 
button UD, an update command is transmitted to the server 1. 
In a second step SE2 of the composition processing (Fig. 9), 
in response to reception of the update command, the server 1 
having received this command transmits the latest music data 
contents to the client PC. Upon receiving the latest music 
data from the server 1 , in a third step CE3 of the 
composition applet processing (Fig. 10), the client PC 
displays the received music data contents, for example, on 
the score area SA of the "composition window". 

As described above, and referring back to Figs. 1, 2 



and 3, the inventive system is designed for editing music 
data to create a music composition according to composing 
data representative of a material of the music composition. 
The inventive system is constructed by a plurality of client 
apparatuses 2, 3 and a server apparatus 1 that connects to 
the plurality of the client apparatuses 2, 3 through a 
network 4 to communicate with the plurality of the client 
apparatuses 2, 3. In each client apparatus 2, an interface 
section 2a can be operated to transmit composing data and to 
receive music data. In the server apparatus 1, a composing 
section la edits the music data according to the composing 
data fed from the plurality of the client apparatuses 2, 3, 
and a feedback section 17 feeds back the edited music data to 
the plurality of the client apparatuses 2, 3 so that each 
client apparatus 2 can collaborate with other client 
apparatus 3 for creating the music composition by repetition 
of the transmitting of the composing data and the receiving 
of the music data. Preferably, each client apparatus 2, 3 
downloads a program from the server client 1 so as to install 
the interface section 2a by the downloaded program in each 
client apparatus 2 for transmitting the composing data and 
receiving the music data. Further, each client apparatus 2 
has an output device 66 for displaying the received music 
data in the form of a score of the music composition and an 
input device 64, 65 for inputting the composing data in the 
form of music symbols superposed on the displayed score of 
the music composition. 
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Furthermore, for the parent client PC, when the user 
operates the "store in server (public)" button PS or "store 
in server (personal)" button SS, in step CE4 of the 
composition applet processing (Fig. 10), a server storage 
command is transmitted to the server 1 in response to the 
button operation. Upon receiving the server storage command 
from the parent client PC, in step SE3 of the composition 
processing (Fig. 9), the server 1 stores the corresponding 
music data in the public data storage section 1c or the 
personal data storage section Id. 

Moreover, when the client PC user operates the 
"store in local" button LS, in step CE5 of the composition 
applet processing (Fig. 10), a local storage command is 
transmitted to the server 1 in response to the button 
operation. On the other hand, upon receiving the local 
storage command from the client PC, in step SE4 of the 
composition processing (Fig. 9), the server 1 converts the 
music data to the MIDI data format from internal data format, 
then transmits the converted data to the client PC, and 
thereafter advances to step SE5. Upon receiving the music 
data of the MIDI form, in step CE6 of the composition applet 
processing (Fig. 10), the client PC stores the received music 
data of the MIDI form to the local storage section (2d, 
3d, ...) of the client PC, and then advances to step CE7. 

Subsequently, the server 1 performs "other 
composition processings" in step SE5 (Fig. 9), and 
subsequently returns to the next "other processings" (step 



S5: Fig. 6). Moreover, the client PC performs "other 
composition applet processings" including a sounding 
processing of the inputted note data and the music data being 
composed in step CE7 (Fig, 10), and subsequently returns to 
the next "mailer processing" (step C8 : Fig. 7). 

Additionally, this system may be provided with a 
function of uploading the music data of MIDI form in the 
local storage section (2d, 3d, ...) to the public data 
storage section lc or the personal data storage section Id on 
the server 1. In this case, as one processing of "other 
composition applet processings" of the client PC in the step 
CE7 or "other composition processings" of the server 1 in 
step SE5, the music data in the local storage section is 
converted to the internal data form from the MIDI data form 
on the client PC or the server 1. 

According to one embodiment of the present invention, 
the electronic mail with the URL of the composed music data 
described therein is transmitted by "mailer processing", and 
utilized for access from the receiver of this electronic mail. 
Fig. 11 is a flowchart showing the mailer processing 
conducted in the client PC according to one' embodiment of the 
present invention, and Fig. 12 shows a display screen example 
displayed during the mailer processing on the client PC 
according to one embodiment of the present invention. 

The processing flow of Fig. 11 shows the "mailer 
processing" performed by the client PC in the step C8 of Fig. 
7 in detail. In a first step CM1 of this processing flow, a 
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text is composed such that "music URL" A indicating a 
location in the public data storage section lc of the server 
1 where the object music data is stored is described. In the 
next step CM2, a desired sentence B is added to the text, and 
after designating a mail address C as a transmission 
destination and performing transmission in step CM3, the flow 
returns to the next "other processings" (step C9: Fig. 7). 
Additionally, when there is an access to the "music URL" A 
from the receiver of the electronic mail, in the "other 
processings" (step S5: Fig. 6), the server 1 converts the 
music data stored in the URL from the internal form to the 
MIDI form, and transmits the converted music data to the 
client PC as the accessing receiver. 

A mode for carrying out the music data composition 
according to the present invention has been described above 
with respect to one embodiment, but the composition method is 
not limited to that of the embodiment. For example, the mode 
may comprise designating a composition condition and motif to 
perform automatic composition, that is, designating the 
composition condition and motif from the respective client 
PCs so that composition/edition may be performed on the 
server side. 

Moreover, the music data may be constituted of one 
performance part (e.g., melody), or a plurality of 
performance parts (e.g., melody, rhythm, bass and 
accompaniment). The data of the performance parts such as 
rhythm, bass, and accompaniment may be constituted by 
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combining pre-stored accompaniment style data (several bars 
or another short pattern). Furthermore, the data may be 
constituted by analyzing and automatically applying melody, 
or applying chord progression by manual input of the user, 
5 and controlling the bass and accompaniment part to match with 
the chord progression. 

Examples of a music data format include "event + 
p relative time" as representation of performance event 
y occurrence time by a time elapsed from a previous event, 
lj| "event + absolute time" as representation of the performance 
J* event occurrence time by an absolute time measured in the 
f music or the bar, "pitch (rest) + note length" as 
f representation of music data by note pitch and note length or 
^ rest and rest length, "flat system" constituted by securing a 
i@ memory area for each minimum performance resolution and by 
storing a performance event in the memory area at the 
performance event occurrence time, and other forms. 

Examples of a method for recording the music data at 
a plurality of channels (parts) include a method of recording 
20 the data of the plurality of channels in a mixed manner, and 
a method of dividing and storing the respective channel data 
for each track. Moreover, on the memory, the music data of a 
time series may be stored in a continuous area, or the data 
stored in scattered areas may separately be managed as 
25 continuous data. Specifically, the method is not limited as 
long as the data can be managed as the data continuing in a 
time series manner, and it does not matter whether or not the 
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data is physically continuously stored on the memory. 

The client PC is not limited to a mode specified as 
an electronic instrument or a mode of a personal computer + 
application software, and a sing-alone or karaoke machine, a 
game machine, portable communication terminals such as a 
cellular phone, and an automatic performance piano may be 
used. With the mode specified as the electronic instrument, 
the client PC is not limited to a keyboard instrument, and 
the mode of a stringed instrument type, wind instrument type, 
percussion instrument type or another instrument type may be 
used. Moreover, instead of incorporating the sound source 
device, automatic performance device, and the like in one 
client PC main body, the respective devices are separate 
devices, and are connected to one another using MIDI, various 
networks and other communication means. Moreover, various 
data utilized for processing programs and various programs 
may be supplied to the client PC from the external storage 
medium, or from the external device via the communication 
interface . 

As described above, according to the main aspect of 
the invention, for the music data composition system of the 
present invention, the system provided with the chat function 
is constituted in such a manner that conversation data 
(message) is exchanged among a plurality of information 
processing terminals (client PCs), the composing data (notes 
and other music symbols) are inputted and edited in the 
respective information processing terminals, and the music 
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data is composed based on exchange of conversation data and 
inputted composing data. Therefore, a plurality of users who 
operate the plurality of information processing terminals are 
chatting with each other while inputting/editing the 

5 composing data to compose the music data based on the 
composing data, and an effect is obtained that the plurality 
of users present ideas to compose the musical work. 

]i Further, in the music data composition system 

according to the additional aspect of the present invention, 

6 in the system constituted of a plurality of client 

I apparatuses and the server apparatus, the conversation data 

is exchanged among the client apparatuses, the composing data 
is inputted/edited in the respective client apparatuses, and 

:f the server apparatus composes the music data based on the 

I inputted/edited composing data, so that the composed latest 
music data is transmitted to the client apparatus and 
displayed. Therefore, the respective client apparatuses can 
access the common music data, and perform the score 
input /edit ion, and an effect is obtained that collaboration 

3 is possible by the plurality of users who operate the 
plurality of client apparatuses, respectively. 

Furthermore, in the music data composition system 
according to the further aspect of the present invention, the 
parentage is set among the plurality of client apparatuses, 

> the conversation data is exchanged among these client 

apparatuses, the composing data is inputted/edited in the 
respective client apparatuses, and the server apparatus 
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composes the music data based on the inputted/edited 
composing data. Additionally, the executable functions in 
the parent client apparatus and child client apparatus are 
allowed to differ from each other (specifically, the parent 
client apparatus is set to be multifunctional), so that the 
user who operates the parent client apparatus can be provided 
with the leadership of the entire music data composition. 
Therefore, an effect is obtained that the collaborating 
operation by the plurality of users can easily be managed. 



